| Author |
Thread Statistics | Show CCP posts - 14 post(s) |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
2
   |
Posted - 2015.07.15 16:56:46 -
[1] - Quote
Share some info!
At least we could help!
|
Daksa Crendraven
Imperial Guardians
Executive Outcomes
2
|
Posted - 2015.07.15 17:05:15 -
[2] - Quote
Ok.. im going to dinner now.. guess ill have to pass the evening in real-life :) |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
2
|
Posted - 2015.07.15 18:27:26 -
[3] - Quote
I just would like to remember everyone that today is Windows Patch day.......................................... |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
2
|
Posted - 2015.07.15 18:49:55 -
[4] - Quote
Terry Gillan wrote:Quote:https://wiki.eveonline.com/en/wiki/Tranquility
"The server used is an IBM x3850 M2 server with 128 GB RAM and two 2.6 GHz six core Xeons (Dunnington) running Windows server 2008 x64 Enterprise Edition and Microsoft SQL Server 2008." The pc I am playing on is not that much behind lols. Btw now that I know it's run on Win server I have no more doubs as to why it failed : Microsoft: What you picked out of the whole cluster is just specs of one alone DB server. DB server does not need that much of a CPU power, but rather a lot of fast memory and really fast storage. You may have missed the part about 60 blades, each equipped with 2 dualcore processors.
As I said: today is MS patch day.  |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
3
|
Posted - 2015.07.15 19:26:42 -
[5] - Quote
Eli Stan wrote:CCP Falcon wrote:
UPDATES:
13:00 UTC - AFTER SEVERAL FAILED STARTUPS, WE ARE CURRENTLY INVESTIGATING A STARTUP ISSUE
13:30 UTC - INVESTIGATION IS STILL ONGOING - NO FURTHER ETA ON UPTIME FOR TRANQUILITY
13:37 UTC - STARTUP FAILED AGAIN - INVESTIGATION IS ONGOING
14:00 UTC - INVESTIGATION IS STILL ONGOING
14:30 UTC - WE ARE CURRENTLY IN THE PROCESS OF REBOOTING AFTER FAULTFINDING AND CHANGES
15:00 UTC - FURTHER ATTEMPTS TO START UP HAVE FAILED - INVESTIGATION IS ONGOING
15:30 UTC - INVESTIGATION STILL ONGOING - NO ETA ON SERVER UPTIME
16:00 UTC - A FURTHER FAILED STARTUP AFTER A NUMBER OF CHANGES - INVESTIGATION ONGOING
17:00 UTC - INVESTIGATIONS STILL ONGOING - NO ETA ON SERVER UPTIME
17:30 UTC - WE ARE CURRENTLY FAULTFINDING - NO ETA ON SERVER UPTIME
18:00 UTC - AFTER TESTING ON SINGULARITY WE WILL BE REBOOTING TQ TO TEST A FIX
18:30 UTC - WE ARE CURRENTLY STILL FAULTFINDING ON TQ - NO ETA FOR UPTIME AT THIS STAGE
19:00 UTC - WE ARE CURRENTLY TESTING A FIX FOR THE ISSUES ON TQ. NO ETA FOR UPTIME AT THIS STAGE
Thank you for the updates. o7 Being in IT and having been through a few downtimes that lasted much longer than expected, and some unexpected downtimes as well, I'd like to offer some advice that's helped me out a lot. Send somebody out to go get some food, and have the whole team decompress in a conference room for a while.Talk about stuff other than work. Elevate the mood. Lower the stress. Give the analytic and creative thought processes time to regenerate.
Absolutely agree.
That helped me a lot in the past in dozens of different emergency situations.
Relax a bit, have fun, talk about possible solutions and future visions.
Unplug your brain area that is usually devoted to work and expectancies.
Then rejoin up, review your to-do-list, review your code, and let us finally brawl inside the new FozzieSov.
Keep up the good work CCP,
You are the best! |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
5
|
Posted - 2015.07.15 20:38:28 -
[6] - Quote
CCP Falcon wrote:Riddler Ronuken wrote:Slowdive Aideron wrote: wrote:
20:00 UTC - PIZZA HAS BEEN ACQUIRED AND WE ARE CURRENTLY REFUELLING OUR DEVS!
Thats exactly what we do when we have some massive problems with our infrastructure at the datacenter and everyone is doing overtime. Sit about with your dicks in your hands and eat pizza? Gee let me know which DC that is so I can make sure to never rent servers there. Sorry if CCP are looking out for the welfare of their employees by feeding them and making sure they're not going hungry when they've been working 9 hours solid on a severe technical issue.
Just ignore this.
Decompressing an emergency situation is the most important things to do from an HR pov after a long overtime session during a DR event.
Now just relax, take the right time, unplug your brain a bit (most important thing of all)..
Then start review your task with no pressure, and re-organize the team with his priorities and to-do lists.
:)
Server/Hardware management is an hard work in these types of situation and this little trick is the social key to resolve your DR session without any further problem.
Another good thing that I always do in such situations is to analyze the context while applying the defined solution, then write up everything i can, from techspecs aspects, to social aspects of the actual session and issue, then.. after the issue is resolved i confront the outcomes with all the team (maybe in a pub, with a beer in my hand) in order to share some visions about future improvements and needs.
A lot of nice internal best practices has been created in this way.
One time after we finally resolved a big problem on a Vmware cluster at 4.50am on friday night (after a pizza session at 1am)... (YEAH)
We decided to end up the line in a pub at 5.20am.. during the drunk brawl that subsequently happened one of my colleagues decided to make a little written "recap" of the whole situation involving a bad engineered infrastructure where we have been called to resolve a big problem, a nice hack to make things work again, another good hack for 3 differents db that were needed to be fixed, and hardware fix that have pushed the infrastructure to be resilient to those types of outages in the future.
A piece of this recap is now part of the Veeam Backup Knowledge Base.
All thanks to a good "Pizza Margherita" (and not to xXxPiZzaxXx) and a relaxed enviroment in the hardest context.
ps. sorry xXxPiZzaxXx |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
6
|
Posted - 2015.07.15 21:59:07 -
[7] - Quote
Guys!
I ve found the truth.
They are bringing Tranquillity in the real world.
Look what SETI and NRAO did just found!
A coercer warping near our planet!
CCP is planting a PI tower near our moon! |
Daksa Crendraven
Imperial Guardians
Executive Outcomes
6
|
Posted - 2015.07.15 22:29:50 -
[8] - Quote
4 players in the cluster...
Maybe...
It's Happening!! |
| |
|